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(54) STREAM EDITER AND STREAM DECODER 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide the stream editer that edits a 
moving image data stream so as to be reproduced without disturbing a 
video image. 

SOLUTION: In the case of editing a stream with a structure of a group 
of picture GOP by the editer 2, an edit reception means 3 receives an 
input command of edit class with respect to the stream 1 . Furthermore, 
edit processing means 4-6 apply edit processing to the stream, based on 
the edit class, and a header information read means 7 reads independent 
information of a GOP directly from header information of the GOP just 
after the GOP arranged just before is changed attended with the edit 
processing Then a header information update means 8 receives an 
instruction input of pattern selection information with respect to the 
just-after GOP when the just-after GOP is not independent, and adds 
the pattern selection information instructed to the header information of 
the just-after GOP to update the header information. 
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Japanese Unexamined Patent Application Publication No. 11-75156 
SPECIFICATION <EXCERPT> 

[0006] The header information includes a start code of the GOP and 
a time code indicating the time from the stream head of the GOP. 
Moreover, the header information includes a closed GOP flag 
indicating whether or not the GOP is independent and a broken link 
flag indicating whether or not the data of the immediately preceding 
GOP is available for reproducing the GOP. 

[0007] In the case where the closed GOP flag is set in the header 
information of the GOP included in the generated stream, the GOP is 
independent. This shows that the GOP does not have a B picture, 
that is, picture data that is coded based on a prediction obtained 
from picture data included in other GOPs. As a result, 
independency is more emphasized than picture quality in the stream, 
which facilitates editing. 

[0041] When a GOP which is not independent (CG = 0) and to which 
preceding GOP data (BL = 1) is not available in decoding is 
inevitably generated as a result of switching of streams, a 
GOP-header-information generation unit 46 of a stream switching 
apparatus 40, to which a stream editing apparatus of the present 
invention is applied, generates new header information by adding 
picture-pattern selection information to the user data field of the 
header information of the GOP. 

[0042] In the case of receiving an instruction for generating a black 
picture from the GOP-header-information generation unit 46, a 
black picture generation unit 47 generates a black picture, which is 
a still and entirely black picture, and inputs the black picture to a 
multiplexed stream generation unit 50. In the case of receiving an 
instruction for rewriting the header information of a specific GOP 

- 1 - 



FP03122-IDS (2) 



from the GOP-header-information generation unit 46, the 
GOP-header-information rewriting units 48 and 49 write, over the 
target header information, new header information to be inputted. 
[0043] The multiplexed stream generation unit 50 switches among 
the black picture, a stream A, and a stream B, so as to generate the 
stream C based on timing information inputted from the timing 
information generation unit 43. 

[0044] Thus, when the GOP which is not independent and to which 
preceding GOP data is not available in decoding is inevitably 
generated as a result of the switching process, the stream switching 
apparatus 40, to which the stream editing apparatus of the present 
invention is applied, adds the picture-pattern selection information, 
which is an instruction about an alternative expression for 
dependent picture data (B picture) included in the GOP, to the 
header information of the GOP. This allows a moving picture 
stream to be switched to generate a new stream so that the image is 
reproduced without distortion. 

[0045] A stream decoding apparatus that decodes the stream edited 
by the stream editing apparatus of the present invention to obtain a 
reproduction picture includes: a header information reading unit for 
reading dependency information of the GOP and the picture-pattern 
selection information from the header information of the GOP; and a 
moving picture decoding unit for decoding the GOP based on the 
read picture-pattern selection information in the case where the 
GOP is not independent (CG = 0) but is not able to depend on the 
other GOPs (BL = 1) and has the picture-pattern selection 
information. 

[0046] FIG. 5 is a diagram showing a transition of a picture order 
when the stream newly generated by the stream switching 
apparatus 40, to which the stream editing apparatus of the present 
invention is applied, is decoded so that the reproduction picture is 
obtained. 
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[0047] Here, a stream 50 consists of two kinds of streams connected 
together at a switching point 50a 7 so that a GOP x and a GOP n are not 
related. Therefore, the P picture of a frame 61 is not usable in 
decoding a frame 62. 

[0048] According to the present invention, the picture-pattern 
selection information is added to the header information of the GOP n 
In the case where the added picture-pattern selection information is 
a black-picture instruction a black picture is displayed, in decoding, 
as an alternative expression for the frame 62, which was a B picture, 
so that the reproduction picture 60 is obtained. 
[0049] Moreover, in the case where the added picture-pattern 
selection information is a freeze instruction, the frame 61 is 
displayed again as an alternative expression for the frame 62, which 
was a B picture, so that the reproduction picture 60 is obtained. 
[0050] Furthermore, in the case where the added picture-pattern 
selection information is an imperfect instruction, an imperfect 
picture that depends only on an I picture 63 in the backward 
direction is generated and displayed as an alternative expression for 
the frame 62, which was B picture depending bi-directionally on an 
I picture and a P picture that should have been included in a GOP n -i, 
and an I picture 63, so that the reproduction picture 60 is obtained. 
[0051] Furthermore, in the case where the added picture-pattern 
selection information is a pseudo-picture instruction, a still 
cross-dissolved picture is generated from the P picture 61 and the I 
picture 63, and displayed as an alternative expression for the frame 
62, which was a B picture, so that the reproduction picture 60 is 
obtained. 

[0052] Accordingly, the stream editing apparatus of the present 
invention adds the picture-pattern selection information, which 
makes an instruction about an alternative expression for the 
dependent picture data (B picture) included in the GOP that is not 
independent but is not able to depend on the other GOPs, to the 
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header information of the GOP. This allows editing of the moving 
picture stream without distortion of the reproduced image. 
[0053] Moreover, even when the GOP of the stream is not 
independent but is not able to depend on the other GOPs, the stream 
decoding apparatus of the present invention is capable of 
reproducing, based on the added picture-pattern selection 
information, the coded moving picture data stream without 
distortion of the image. 

[0054] Note that, since the compatibility of data is maintained, 
there is no disadvantage when the stream including the 
picture-pattern selection information edited by the stream editing 
apparatus of the present invention is decoded by a decoder without 
a function to reproduce the reproduction picture based on the 
picture-pattern selection information. 
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GOP^yj#fl|f[**4M.tt4 8 % 4 9fc, llftxF 
y -AM^S 5 0 i £WLTV^ C 
[0 0 3 7] GOP-^tt#fic*&9§B4 1, 4 2 
i4, ^hy-AA, BCDGOPCD— -.y^iffR^&GO 
P©t7ftSNiGOP W343itttf * t £fic#-® <5 0 
«^&o7tt^f--ti&:NI4^5>- ^tf ffi^a 4 3 
il&rtSo fl^&ofc&£ttW«f4GOP-^ 
'lff#£/&S34 6 ta»i1-5 0 30 

[0038] ^5 y ^'it #4^4 3 (4, * h y -A 

fc, 5>^1S*4dclBJ4 3ii, il*D£;H5«-G 

OPOfc'^-tfcN^ib, ^ h !)-AAi^ h y -AB 

[0 0 3 9] V-i $y^W»ffi^^y 4 4, 4 5(4, © 
#X.^GOP<0^y^tf#©*#^x.Wfcfc(DB#P B ^ptfj 
^Ht?, GOP-^tt^£j5)c£|5 4 6CK4, a-lf^ 40 

J&gfl4 6(4, ^-Y $ >^tt^fig§B4 3^^A^I$tl-5 
^ ?>^tffgi, GOP-y^fflf«SK<J6*>«IU 1, 

[0040] r r-T5-—->^tf#icov^Tiii5^-r5 0 mp 

E G CDii-a-, GOP ©— v ^'[t#(4, G S C (Group St 
art Code : GOP©lji^ - K) t, TC (Time Code 50 
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:^^fA3-K) t, CG (Closed GOP : GOPflffl 

W&.fttk<D g o p l xw^itxh 5 r t 

1-3£&fflf$R) BL (Broken Link i^rTSGO 
Px-^^li^rofcfetciittffl/FnlT-fcS r t £*-f1tfc 

ESC (Extension Start Code : ff*J3 <K¥lWt — #W 

= — K) tGED (Group Extension Data : 
9) -*c\ UDSC (User Data Start Code : a-f f- 
ptDmU:^— K) tUD (User Data : 3L— iff 5 — ^) 

[004 1] #383U©* h y -AfsASgSrilffl Lfe^. 
hy-A§]#x.^g4 0©GOP---^^tflS^ai4 6 

(CG=0) ichtflb-t. Mt5GOPr-^?rff 
©Rfc:«Efll:T?#&V^ (BL=l) GOP^4LTU 
ofc#£-f', r(DGOP^->^1f«(73UD««(-Hffi 

'So 

[0 0 4 2] mili^^a54 7(4, GO P^j/^flWR£ 
fiXg|I4 6^bm®^©^fg7j%^^ 0 f c ^{c, 

tt?r#Sft:x hy-A±jtgP5 OfcA^-fSo GOP— 
^flWR»#*^Sl5 4 8, 4 9 (4, GOPAy yffi®& 
figg|54 6^f>#^(DGOPCD— y^mmM%^<r)^ 
^fcofc#^-(C, K^1-5GOP^s/^1f«^, A^l 

[0 04 3] -fr LT#afb^ h y 5 0 (4, * 

^ 5 y^'|f|g^f|54 3d^A^J^tt5^-r 5 y^'tf$g 

§j#x£tTo-c, ^ hy-Ac^r^i-So 
[0 0 4 4] ro45fc, *^<£>*hy— AHit 
^iiii tfcx h y -A§i#x.ig«4 o t-(4, §i#^a 

Klio-C, ailiLTV^ilM'^^T^tt-SGOPT 
— ^Sr : S"§ _ (^ ) ^(c:'te^T?#^V'>GOP^^^:LTL4 5 

(Bt°^^-^) (c*i-r5ft#*msrit*'t-5irffis^if 
[oo4 5] *^co^ hv-^mmmmi^xmrn^h 

tz* h y -A W§-LTI¥£®£»5* h y -A^g 
g(4, GOP CD—; J/ ^''if t G O P C0ft#tttf « 

ir, ffflGOPi?, 34^z:LTV^/ c et^ (cg=o) (rfc^ 

f.-f, teoGOPtftffT't-f (bl = d , wrnmvi 
tf#tr«Fo»^-t(4, wgop^ m^wt-otzmmm 

[0 04 6] H 5 (4, **sjcox K y -AH^^B^ii 
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[0 04 7] >U— A5 0(1, 2«is©^hy 

-A^S#X.f4K5 0 aT'SiWLfctW-^fcoT, GO 

[0048] *«flT?#Go p, (D^y^mmimmm 
zMffimfcmmmw&m^xfo^tzm&'icn, b try 

^-^Xh-^tcy V — 1\ 6 2 <Dft#*Si LT, 
**L-C, 6 0 ; |r#5o 

[0049] #*n§tiT^sPiffi^ff«^7 y 

—XJt^TfcofcW^lllfi, B Wf^Xfootzy 
A 6 2©ftf«,!:LT, 1 fc^LT 

ff4I6 0«l5 t !m. 
[0 0 5 0] MIC, ttJp^ftTV^Hffiit^ff^^E 

OI, PWfth ;I f7ft63i fc3££filfc0S# 
t5Bf7ft^ot7W|6 2 (75ft# A51 > L 
■C, 1 t'^-t 6 3 ©£$ifc aUriSj \mm • 5 >F7c£*$. 

[0 0 5 1]-?: LT V ffil £ *fC ^ 4 PiffiiltRffifB/^&l 

y V—h. 6 2C0ft#*|| t IT, Pf7ft 6 1 1 1 fcf 
7ft6 3 4r*»P>8SUhWO^ n^f-f yVu-/£±fiju r. 

[0 0 5 2] roJ:5k, #£91©* h y-AH3|igg 
Tilsit LTV ^ftwcfe j«] h-fs ft© G O P icfe#T*# 
fc v ^ G O P m-g-* ftfcpNS £ t?> ^ -t 5*— > (B fc"^ 7 ^ L 
■Y) K^5ft»^itJB^5BffBWinMS«rs ^<7> 

[0 0 5 3] *fc s #36113'©;* h y -^tfSttii, 

w-g-fl; £ tifcRffi^x - * © h y - a £ , #ip $ jtfc 

[0 0 54] #3P71©X F y -A««^«-C«Kfe 
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IMfeiSfiWiil-CV^©-^ B«!SWffif«fcS<3V^Tff4. 
[0 0 5 5] 

[«w©a*] iy.±t£0jL7-cj;5i-*fiw©* hy-A 
^ i- ©aitr © g o p tmMiz. iotfit^ofct^ 

iC^GOPiC-g-Stbfc^^t^^YX-^ (Bfc° 
1 0 GOPO^y ^tt$g ictttJPf- 5«iLfeo 

t\ mm&<Dx h y - a §wi>£SL-f r 1 4 < w^-e 

[0 0 5 6] *fcvRfcttWt*:J:5l!:, #3Py§©#3§ 

;?©* f y * h y -a<d^/p-t° • 

2h/ • t?^-r (GOP) tf$ v »:£LTV^W£%ffifc 

1\ ^{-fcfc-Q-cffM©GaPicft#-c#4v^ (:/n 

— y >- • y>^ • 77^itoTV^) *g-tft>, 

Go'psr, ^y^mm^mmLtcmmmm.mmcm^ 

fci«rtB 
. [«ffi©fK*Lft!PJ] 

: [jn i ] *^pyi©^ h y -Aiw«6«ojsosii»ja**i- 

7*P-7 7@t*fe5„ 
[0 2] Hl"fcS«tfc^ hy-AS*»g{CT«)®^x 
— > (7)x h y — A %mfkirZ #101** Lfc 7 n y - 

[H3] ftpf^^^-i-ftLT, GOPtMjfoyhy 
-ASr^Lfc*g-, SIF^ h y-A*m-^L-CW4® 

[04] *|§PJ(©^ hy-AS*i$S*iifflLfcx hy 

- A®# iLSKOPfMlfS &*fB -c & 5 „ 

[H 5 ] h y -AS*gg*Bji Lfcx h y 

[«F-§-©iftia] 

l- ^hy-A N 2 ^by-AH^ss, 3 

40 mm^n^. a Gopi^m 5 gops 

A^S, 6 ^hy-A«]#x.#^, 7 ^y^fflf 
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